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Description 

Technical Field 

The present invention relates to a hierarchical 
information processing system for processing an 
information in a cascade of successively arranged 
plural information processing layers in each of 
which plural nonlinear elements are two-dimension- 
ally arranged, particularly, provided with an autoas- 
sociative recall type high grade associative mem- 
ory function by which a pattern consisting of char- 
acters and figures excessively distorted in shape or 
excessively shifted in position, or accompanied 
with expansion or reduction can be readily and 
accurately recognized, as well as noise contained 
therein can be removed or defected portions there- 
of can be interpolated. 

Technical Background 

As for a network required for recalling or rec- 
ognizing a complete pattern on the basis of an 
incomplete pattern, various kinds of autoassociative 
recall type associative memory networks have 
been conventionally proposed. However, most of 
these conventional associative memory networks 
could be satisfactorily operated only when an input 
pattern did not only consist of a previously learned 
training pattern, but also the former completely 
coincided with the latter in size", shape and posi- 
tion. Although an associative memory system such 
as those employing an autocorrelation function ac- 
cepting only the shift in position of the input pattern 
has been conventionally proposed, this conven- 
tional system also was completely impotent with 
regard to the change in size and the distortion in 
shape of the pattern. 

The present applicant has already disclosed a 
pattern recognition system called as "neocog- 
nitron" in the specifications of Japanese Patent'No. 
1221756 (Japanese Patent Application Publication 
No. 58-53790) "A pattern recognition system" and 
Japanese Patent No. 1279063 (Japanese Patent 
Application Publication No. 60-712) "A pattern rec- 
ognition equipment", which system is provided with 
an ability for correctly recognizing a pattern without 
any affection of those mentioned above, that is, the 
shift in position, the distortion inshape, the change 
in size and the like of the input pattern. However, 
these disclosed system and equipment relate to no 
more than the pattern recognition restricted within 
the above-mentioned version, and hence have not 
yet been provided with such an ability that an 
information regarding a phenomenon is derived 
from incomplete or ambiguous informations with 
regard thereto by the autoassociative recall, that is, 
the associative memory function required for attain- 
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ing a further higher grade pattern recognition. 

On the other hand, the present applicant has 
also disclosed, as for a system provided with the 
aforesaid associative memory function, a hierarchi- 

5 cal information processing network in Japanese 
Patent Application Laid-open Publication No. 59- 
163679 "A hierarchical information processing net- 
work", which network is provided with an ability 
such that similar patterns resembling a previously 

w learned training pattern are successively selected 
in turn from plural input patterns, or, a complete 
pattern is recalled from an incomplete input pattern 
or an input pattern obscured by noise. This system 
is considered to represent the closest prior art. 

15 However, this hierarchical information processing 
network has not yet also been provided with the 
aforesaid ability for processing the shift in position 
and the deformation in shape of the input pattern, 
similarly as the conventional associative memory 

20 systems which have been proposed everywhere. 

Disclosure of the Invention 

An object of the present invention is to remove 

25 the above-mentioned various shortcomings, and to 
provide a novel hierarchical information processing 
system in which the above-disclosed hierarchical 
information processing network is offered with an 
ability such that the pattern recognition can be 

so achieved without any affection of considerable de- 
fects such as the deformation in shape, the change 
in size and the shift in position of the input pattern, 
as is different from the aforesaid "neocognitron", 
but with a higher grade autoassociative recall type 

35 associative memory function and further with a 
faculty of segmentation. 

The invention is set out in claim 1 . 
Accordingly, in the hierarchical information pro- 
cessing system of the present invention, for achiev- 

40 ing the information processing mainly through the 
aforesaid hierarchical information processing net- 
work: 

both of afferent signal paths extended upwards 
from lower order stages on the pattern input side to 

45 higher order stages on the recognition output side 
and efferent signal paths extended downwards 
from higher order stages to lower order stages on 
the contrary are provided; 

an input information supplied to the lower order 

50 stages is successively transmitted to the higher 
order stages through the afferent signal paths, as 
being successively processed in each of plural 
cell-layers of successive order stages, meanwhile, 
in the direction opposite thereto, an output derived 

55 from the higher order stages is fed-back to the 
lower order stages through the efferent signal 

once an output response has been derived 
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from the higher order stages, according to the 
action of the efferent signal transmitted from the 
higher order stages to the lower order stages, the 
afferent signal paths contributing to cause the out- 
put response in the higher order stages and the 
information processing processes belonging thereto 
are affected by an excitatory effect, while the re- 
maining efferent signal paths and the information 
processing processes belonging thereto are affect- 
ed by an inhibitory effect; 

the ability of the pattern segmentation, that is, 
the distinction of components of a specified pattern 
from the remainder is offered by selectively' ex- 
tracting only the information relevant to the speci- 
fied pattern from plural patterns supplied to the 
lower order stages on the input side; or 

a complete pattern can be associatively re- 
called from an incomplete pattern by removing 
noise contained therein or by interpolating missing 
portions thereof. 

Brief Description of the Drawings 

Fig. 1 is a block diagram showing an example of 
hierarchical structure of an neural network model 
employed for a hierarchical information process- 
ing network of the system according to the 
present invention; and 

Fig. 2 is a block diagram showing an example of 
spatial connection between network elements in 
a part of the hierarchical structure as shown in 
Fig. 1. 

Best Mode for Carrying out the Present Invention 

Generally speaking, when a composite pattern 
consisting of a combination of more than two pat- 
terns is presented, our human being is able to 
observe one of these patterns at a time with atten- 
tion in order and, as a result, to individually recog- 
nize what is each of these patterns, as well as to 
effect the aforesaid pattern segmentation. Besides, 
at the same time, even when the pattern observed 
with attention is deteriorated by defects or noise, 
our human being is able to associate a complete 
pattern by interpolating those defects or by remov- 
ing the noise. In this connection, it is not required 
that the presented pattern completely coincides 
with the previously learned training pattern in 
shape or in size. Our human being is provided with 
an ability for completing the original, even when 
the shape thereof is somewhat distorted or the size 
thereof is changed, by directly interpolating defects 
of the distorted pattern or by directly removing 
noise therefrom, and further by effectively utilizing 
a slight trace remaining in the defective portion of 
the attended pattern. The information processing 
system of the present invention has been proposed 



on the basis of the neural network model provided 
for realizing this ability of our human being. 

A preferred embodiment of the present inven- 
tion will be described in detail hereinafter by refer- 
5 ring to the accompanying drawings. 

An embodiment based on a multilayered net- 
work consisting of network elements arranged in 
layer state will be described hereinafter. However, 
as for the concrete realization, it is enough to carry 
w out the same algorithm, so that it is not necessary 
at all to restrict the embodiment to be described 
within the structure of the above multilayered net- 
work. 

In general, the neural network model used for 

J5 the pattern recognition equipment is composed of 
a combination of plural cell-layers in which plural 
cells are arranged in multilayer state, and hence 
the hierarchical structure as shown in a block dia- 
gram of Fig. 1 is exemplified as of four layers. In 

20 this block diagram, a circular mark O indicates a 
cell. Although each of the cell layers actually con- 
tains plural cells, plural cells of each kind are 
represented by only one cell in Fig. 1. Besides 
connections as indicated by single or double lines 

25 in Fig. 1 exist between these cells, the single line 
showing the existence of one-to-one connection 
between heterogeneous cells corresponding to 
each other, while the double line showing the exis- 
tence of converging or diverging connection be- 

30 tween two groups of cells. 

In this regard, the afferent signal is processed 
in the same structure as that of "neocognition" as 
described in the specifications of Japanese Patents 
Nos. 1221756 and 1279063. In this structure, a 

35 feature-extracting cell u s (including u s i, u s2 , u s3 and 
so forth) extracts the feature of the pattern in 
association with an inhibitory cell u sv . Hence, only 
when a specified feature exists in a specified por- 
tion of the input cell-layer, an output response is 

40 derived therefrom. On the other hand, a feature- 
integrating cell u c extracts the same feature also. 
However, this cell u c receives output responses 
respectively derived from plural feature-extracting 
cells u s positioned in different portions of the input 

45 cell layers, so that, even when the position for 
indicating the same feature in the input layer is 
shifted to some extent, the feature-integrating cell 
u c itself continues to extract the same feature. An 
aspect of spatial interconnections between these 

so cells u s and u c is shown in Fig. 2. 

As described above, the afferent signal gradu- 
ally integrates local features into a global feature, 
as the extraction and the integration of features are 
repeated in each layer of the multilayered network, 

55 and hence, the feature-integrating cell u c inthe final 
layer globally observes the feature extracted from 
the whole input layer, namely, the input pattern, 
and, as a result, what is the input pattern can be 



4 



EP 0 245 508 B1 



recognized. 

In other words, an output response of the final 
cell-layer is derived from only one feature-integrat- 
ing cell u c corresponding to the category of the 
input pattern in response to what is the category 
concerned. In these processes of the extraction 
and the intergration of features, the shift in position 
of these features from each other is gradually ac- 
cepted, and hence, the accurate pattern recognition 
can be realized in the final cell-layer without any 
affection of shift in position as well as distortion in 
shape of the pattern supplied to the input cell-layer. 

As for the above mentioned processing of the 
afferent signal, the same structure of network as 
that of "neocognitron" as disclosed in the speci- 
fication of Japanese Patents Nos. 1221756 and 
1279063 can be employed. 

In contrast with the above, the efferent signal is 
transmitted from the higher order cell-layers to the 
lower order cell-layers through a feature-indicating 
cell w s and an intergrative feature-indicating cell w c 
which make pairs with the feature-extracting cell u s 
and the feature-integrating cell u 0 as described 
above, respectively. That is, the efferent signal is 
transmitted downwards through the path just op- 
posite to that of the afferent signal transmitted 
upwards. 

In order to attain the above situation, it is 
sufficient that the coefficients of connections be- 
tween each cell are arranged such that the efferent 
signal derived downwards from the feature-indicat- 
ing cell w s is transmitted through the path just 
opposite to that through which the afferent signal is 
transmitted toward the feature-extracting cell u s 
paired therewith. In this regard, a feature-indicating 
inhibitory cell w sv is an auxiliary cell corresponding 
to an inhibitory cell Usv for inhibiting the afferent 
signal. As for the structure concerning these cells, 
substantially the same structure as that of the hier- 
archical information processing network as dis- 
closed in Japanese Patent Application Laid-open 
Publication No. 59-163679 can be employed. 

However, the path of the efferent signal trans- 
mitted downwards from the integrative feature-in- 
dicating cell w c to the feature-indicating cell w s in 
the preceding cell-layer cannot be individually set 
up for the convenience of the efferent signal con- 
cerned. It is because the feature-integrating cell u c 
paired with the integrative feature-indicating cell w c 
is arranged so as to derive an output response, 
whenever any one of plural feature-extracting cells 
u s in the preceding cell-layer derives an output 
therefrom. So that, the efferent, signal divergently 
derived from the integrative feature-indicating cell 
w c is transmitted to plural feature-indicating cells 
w s , these cells w s further receiving a signal operat- 
ing as a gating signal from the feature-extracting 
cell u s corresponding thereto and hence being ar- 



ranged to derive an output only when the signals 
are derived from both of the feature-extracting cell 
u s and the integrative feature-indicating cell w c 
thereto. According to this arrangement, as for the 

5 efferent connection from the integrative feature- 
indicating cell w c to the feature-indicating cell w s 
also, the efferent signal can be transmitted down- 
wards through the same path as the afferent signal 
paired therewith and transmitted upwards from the 

70 feature-extracting cell u s to the feature-integrating 
cell u c . 

On the other hand, the efferent signal is not 
only affected by the afferent signal as mentioned 
above, but also affects the afferent signal on the 

is contrary. That is, the fact that an output is derived 
from one of the feature-integrating cells u c in the 
highest order stage of the network means that the 
pattern belonging to the category corresponding to 
the feature-integrating cell u c concerned has been 

20 recognized through the network concerned. In this 
situation, the efferent signal transmitted downwards 
from the feature-integrating cell u c in the highest 
order stage is arranged so as to be supplied only 
to the cells directly related to the recognition of the 

25 pattern recognized in this situation. In this regard, 
in a situation where the input pattern supplied to 
the lowest order input stage is a composite pattern 
consisting of plural patterns, outputs of the inter- 
mediate stage in the afferent signal path are not 

30 necessarily derived only from the cells correspond- 
ing to the feature of the pattern recognized through 
the final stage, but also derived from the cells 
corresponding to the features of the remaining pat- 
terns. In order to leave only the outputs derived 

35 from the cells corresponding to the feature of the 
finally recognized pattern and to erase the outputs 
derived from the remaining cells, the feature-in- 
tegrating cell u c is provided with an operational 
effect similar to the biological "habituation", so as 

40 to gradually lower the gain between the input and 
the output thereof with the lapse of time. However, 
in conjunction therewith, a signal for forcibly re- 
covering the lowered gain is arranged to be sup- 
plied to the feature-integrating cell u c from the 

45 integrative feature-indicating cell w c paired there- 
with. As a result, the feature-integrating cell u c 
belonging to the path, through which the efferent 
signal is transmitted downwards, is affected by. an 
excitatory effect, and hence the lowering of the 

so gain is not caused. 

The output of the integrative feature-indicating 
cell w c does not only affect the feature-integrating 
cell u c upwards corresponding thereto with the ex- 
citatory effect, but also affects the feature-extract- 

55 ing cell u s . In this regard, the fact that, although an 
efferent output is derived from an intergrative fea- 
ture-indicating cell w c , any afferent output has not 
been derived from the feature-integrating cell u c 
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corresponding thereto means that the feature of the 
pattern, which should be taken charge of by the 
feature-integrating cell u c concerned, fails to be 
extracted thereby. In this situation where, although 
the efferent output is derived from the integrative 
feature-indicating cell w c , any afferent output is not 
derived from the feature-integrating cell u c cor- 
responding thereto, this situation concerned is de- 
tected by a threshold controlling cell w cx . When an 
output is derived from the threshold controlling cell 
Wcx as a result of this detection, this output is 
operated so as to weaken the affection of the 
inhibitory, namely, negative signal supplied to the 
feature-extracting cell u s , and hence the selectivity 
of the feature extraction effected by the feature- 
extracting cell u s concerned is weakened. In short, 
the feature-extracting cell u s supplied with the out- 
put of the threshold controlling cell w cx is forced to 
respond to the feature of the pattern which should 
be originally extracted by the feature-extracting cell 
u s concerned, even if the feature is incomplete to 
some extent. In other words, the feature-extracting 
cell u s is forced to be operated similarly as, when 
our human being observes a blurred character, our 
human being extracts the components of the char- 
acter concerned which should exist in the blurred 
portions thereof with the help of the slight traces 
left in the blurred portions thereof. 

Once the feature has been extracted by the 
feature-extracting cell u s on the basis of at least left 
slight trace thereof as described above, the efferent 
signal is resulted to be transmitted further down- 
wards through the feature-indicating cell w s cor- 
responding to the feature-extracting cell u s con- 
cerned. 

Under the repetition of the above-mentioned 
operation, only the components of the pattern 
which is recognized through the response of the 
feature-integrating cell w c in the final stage is re- 
sulted to appear in the cell-layer in which the 
integrative feature-indicating cell w co of the initial 
stage exists. Moreover, in this situation, the efferent 
signal is resulted to be transmitted downwards 
through the same path as the afferent signal cor- 
responding to the efferent signal concerned. So 
that, even if the input pattern has been deformed 
from the previously learned training pattern, only 
the components corresponding to the recognized 
pattern appear in the cell-layer, in which the integ- 
rative feature-indicating cell w co of the initial stage 
exists, in the just same form as the deformed input 
pattern. Moreover, even if defected portions exist in 
this deformed input pattern, the interpolation which 
naturally corresponds to the deformed input pattern 
is applied onto those defected portions, and hence 
it is resulted that a deformed but indefectible pat- 
tern appears in the cell-layer in which the integ- 
rative feature-indicating cell w co of the initial stage 



exists. 

In this regard, a signal x derived from a maxi- 
mum detector MAX which is presented in the right 
end portion of Fig. 1 is transmitted to all of the 

s feature-extracting cells u s , only when no output is 
derived from any of the feature-integrating cells u c 
of the final stage. This signal x lowers the selectiv- 
ity of the response of the feature-extracting cell u s 
similarly as the aforesaid output of the threshold 

w controlling cell w cx , and hence, even if the feature 
of the input pattern is incomplete, the feature- 
extracting cell u s is arranged so as to extract the 
incomplete feature concerned. As a result, any one 
of the plural patterns supplied as the input is ree- 
fs ognized in the first place. 

As described above, only a part of the input 
composite pattern which corresponds to the speci- 
fied one pattern of the plural patterns contained 
therein is separated therefrom, so as to appear in 

20 the cell-layer in which the integrative feature-in- 
dicating cell w c0 of the initial stage exists, the 
category of the separated pattern concerned can 
be determined, namely, recognized in response to 
which one of the plural feature-integrating cells u c 

25 of the final stage from which one the output has 
been derived. In short, the segmentation in the 
pattern recognition can be effected. In this respect, 
if the output of the cell-layer in which the integ- 
rative feature-indicating cell w co of the initial stage 

30 exists is regarded as an autoassociative recall type 
associative output, an associative memory network 
which is never affected by the deformation and the 
positional error of the input pattern can be re- 
garded to be realized. 

35 In this situation where any one of the plural 

input patterns has been recognized, for setting 
about the recognition of another pattern thereof, it 
is enough to stop the flow of the efferent signal for 
an instant. The feature-integrating cell u c is ar- 

40 ranged such that, when the facilitating signal de- 
rived from the integrative feature-indicating cell w c 
corresponding thereto is stopped, the gain thereof 
lowered by the affection of the effect of "habitua- 
tion" is restored, meanwhile the gain thereof for- 

45 cibly increased by the affection of the facilitating 
signal is lowered in the just same manner as by 
the fatigue in response to the extent of the forcible 
increase of the gain. As a result, after the above 
instant stop of the efferent signal, the previously 

50 recognized components of the input composite pat- 
tern has been made to hardly pass through the 
afferent signal path, and hence another pattern 
different from the initially recognized pattern is 
resulted to be recognized. Accordingly, it is possi- 

55 ble that various kinds of operations such as the 
pattern recognition, the segmentation, the associ- 
ation and the like as described above is succes- 
sively carried out as for one after another of the 
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plural input patterns. 

With regard to the extents of the modifiable 
synaptic connections as indicated in Figs. 1 and 2, 
it is enough to vary the extent of the afferent 
connection by means of the autolearning as dis- 
closed in the specification of Japanese Patent No. 
1279063, as well as to vary the extent of the 
efferent connection in association with the cor- 
responding afferent connection by means of the 
method similar as disclosed in Japanese Patent 
Application Laid-open Publication No. 59-163679. 

In this regard, various kinds of marks respec- 
tively indicating various kinds of connections and 
synapses together with the operations thereof will 
be commented hereinafter in a lump. 

= converging or diverging connection between 
two groups of cells 

- one-to-one connection between two cells cor- 
responding to each other 

— unmodifiable excitatory (positive)synapse 
-> modifiable excitatory (positive) synapse 

h unmodifiable inhibitory (negative) synapse 
-□ modifiable inhibitory (negative) synapse 
-O heterosynaptic facilitating signal for control- 
ling gain of target cell 

-< inhibition weakening signal for controlling 
selectivity of target cell 

Industrial Applicability 

The segmentation in the pattern recognition is 
extremely difficult to be applied particularly as for 
the modified input , pattern such as handwritten 
characters, and hence has been conventionally ef- 
fected, for instance, with the help of parallel 
crosses previously printed on manuscript papers. 

In this regard, according to the present inven- 
tion, as for any possibly deformed pattern, the 
segmentation can be correctly effected without the 
affection of the deformation concerned. 

On the other hand, with respect to the associ- 
ative memory equipment, that of the conventional 
system has been hardly prepared so as to be 
satisfactorily operated, even if the positional error, 
the deformation, the expansion, the reduction or 
the like is contained in the input pattern, meanwhile 
that of the system according to the present inven- 
tion can be prepared so as to be correctly operated 
without the affection of the positional error, the 
deformation, the expansion, the reduction or the 
like. 

This situation can be realized by the fact that 
the information processing network employed for 
the hierarchical information system according to 
the present invention is newly provided with the 
efferent signal path together with the conventional 
afferent path and that such an operation is pre- 
pared between the afferent and the efferent signals, 



so as to facilitate the flow of those signals cor- 
responding to each other, as well as to attenuate 
the flow of those signals not corresponding to each 
other. 

5 As is apparent from the mentioned above, ac- 

cording to the hierarchical information processing 
system of the present invention, it is possible to 
realize a novel pattern recognition equipment pro- 
vided with an extremely higher grade faculty being 

jo quite different from the conventional one such that 
the segmentation is effected by separating only a 
portion corresponding to one specified pattern from 
plural input patterns and that the autoassociative 
recall type associative memory is effected for inter- 

75 polating defected portions of the input pattern. Be- 
sides, in this situation also, the similar faculties as 
of "neocognitron" as disclosed in the specifications 
of Japanese Patents Nos. 1221756 and 1279063 
are naturally maintained such as the correct pattern 

20 recognition can be effected without the affection of 
the distortion in shape, the shift in position, the 
expansion or the reduction of the input pattern. 

Claims 

25 

1. A hierarchical information processing system 
for processing information in parallel over a 
plurality of cell layers whereby layers compris- 
ing cells that perform .similar functions within 
30 the layer are organized in successively or- 
dered stages (uo, ui, .., u n ), said system com- 
prising: 

a plurality of afferent signal paths extend- 
ing from lower order cell-layers of feature- 

35 extracting cells (u s -i) to higher order cell lay- 

ers of feature-extracting cells (u s - n ) with the 
aid of feature extracting inhibitory cells (u sv ) for 
processing afferent information signals, and 
a plurality of efferent signal paths extend- 

40 ing from higher order cell layers of feature 

indicating cells (w s - n ) to lower order cell layers 
(w s --i) for transmitting an efferent signal with 
the aid of a feature-indicating inhibitory cell 
(w sv ), wherein said feature-extracting cell (u s ) in 

45 the afferent signal path is connected to said 

feature-indicating cell (w s ) in each stage and 
said feature-extracting inhibitory cell (u sv ) is 
convergingly and modifiably excitatory con- 
nected to said feature-extracting cell (u s ) in the 

50 same stage and said feature-indicating inhibi- 

tory cell (w sv ) is modifiably inhibitory connect- 
ed from said feature-indicating cell (w s ) to 
divergingly connect to the next lower stage 
feature-indicating cell (Ws-^, 

55 characterized in that: 

said afferent signal path comprises a first 
feature-integrating cell (u co ) in the lowest stage 
and a pair of a feature-extracting cell (u s ) and a 



7 



EP 0 245 508 B1 



feature-integrating cell (u c ) in each higher 
stage and the highest stage is connected to a 
maximum detector; 

said efferent signal path comprises a pair 
of an integrative feature-indicating cell (w c ) and 5 
a feature-indicating cell (w s ) in each stage and 
the integrative feature indicating cell (w c ) of the 
highest stage is connected to said maximum 
detector, and the lowest stage consists of the 
integrative feature-indicating cell (w c ) and each w 
integrative feature-indicating cell (w c ) in each 
stage is connected to the corresponding fea- 
ture-integrating cell (u c ) in each stage, wherein 
said efferent signals are controlled by a plural- 
ity of integrative feature-indicating cells (w 0 ) ?s 
and feature-indicating cells (w s ) alternatively 
and divergingly, whereby each integrative fea- 
ture-indicating cell (w c ) provides paths to a 
plurality of feature-indicating (w s ) cells in the 
same stage, each group of said two pluralities 20 
of integrative feature-indicating (w c ) and fea- 
ture-indicating (w s ) cells corresponding to one 
stage of said stages; 

cell layers in each stage, except input-cell 
layer (u 0 ) of the lowest stage, having converg- 25 
ing afferent connections from feature-extracting 
cells (u s ) to featureintegrating cells (u 0 ) and 
diverging efferent connections from an integ- 
rative feature-indicating cell (w c ) to feature in- 
dicating cell (w s ); 30 

wherein each feature-extracting cell (u s ) is 
connected to send an unmodifiable excitatory 
signal or gate signal to the corresponding fea- 
ture-indicating cell (w s ) within the same stage, 
and each integrative feature-indicating cell (w c ) 35 
is connected to send a gain control signal to a 
corresponding feature-integrating cell (u c ) with- 
in the same stage, and the transmission of 
efferent signals is gated by the afferent signals 
in the feature-indicating cell (w s ), and simurta- 40 
neously, the transmission of afferent signals is 
facilitated by the presence of the efferent sig- 
nals in the integrative feature-indicating cell 
(w c ) whereby contributive ones of the efferent 
signal paths are being affected by an excita- 45 
tory effect, while non-contributory ones thereof 
are being affected by an inhibitory effect; 

whereby a pattern corresponding to the 
cell which is yielding the largest output among 
the feature-integrating cells (u c ) of the highest 50 
stage is interpreted as recognized; and the 
output of the integrative feature-indicating cells 
(w co ) of the lowest stage being interpreted as 
the output of associative recall or as the result 
of segmentation of a single pattern which is ss 
now being recognized. 



2. A hierarchical information processing system 
for processing information in parallel over a 
plurality of cell layers according to claim 1, 
characterized by 

a threshold controlling cell (w cx ) for receiv- 
ing signals from the integrative feature-indicat- 
ing cell (w c ) via unmodifiable excitatory con- 
nections and receiving converging signals from 
the feature-extracting cells (u s ) in the same 
stage and controlling the selectivity for extract- 
ing particular features by said feature-extract- 
ing cells (u s ). 

3. A hierarchical information processing system 
for processing information in parallel over a 
plurality of cell layers as defined in claim 2, 
characterized by said inhibiting cell (u sv ) con- 
vergingly receiving a pattern signal from the 
said feature-integrating cells (u c ) of the preced- 
ing stage and sending output signals via modi- 
fiable inhibitory connections to the said fea- 
ture-extracting cell (u s ), in the same stage. 

4. A hierarchical information processing system 
for processing information in parallel over a 
plurality of cell layers as defined in claim 2 or 
3, characterized by said feature-indicating in- 
hibitory cell (w sv ) being connected to the fea- 
ture-indicating cell (w s ) in the same stage and 
being connected divergingly and unmodifiably 
to the integrative feature-indicating cell (w 0 ) in 
the lower stage. 

5. A hierarchical information processing system 
for processing information in parallel over a 
plurality of cell layers as defined in any of 
claims 2 to 4, characterized in that it further 
comprises feedback means for transmitting a 
signal (x) derived from a maximum detector 
when no output is derived from any of the 
feature-integrating cells (u c ) of the highest 
stage so as to lower the selectivity of each 
target feature-extracting cell (u s ). 

6. A hierarchical information processing system 
for processing information in parallel over a 
plurality of cell layers as defined in claim 2, 
characterized in that the afferent signal path of 
the feature-integrating cell (u c ) and the feature 
extracting cell (u s ) and the efferent signal path 
of the integrative feature-indicating cell (w c ) 
and the feature-indicating cell (w s ) are intercon- 
nected so as to affect said efferent signal by 
gain control signal from integrative feature-in- 
dicating (w c ) cell and to affect efferent signal 
by gate signal from feature-extracting (u s ) cell 
to feature-indicating (w s ) cell; and the feature- 
extracting cell (u s ) is affected by feedback sig- 
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nal (x) from a maximum detector in the highest 
stage, and the integrative feature-indicating cell 
(w c ) is affected by an unmodifiable inhibitory 
signal from the feature-indicating inhibitory cell 
(w sv ) activated by feature-indicating cell (w s ). 5 

Patentanspruche 

1. Hierarchisches Informationsverarbeitungs-Sy- 

stem zur parallelen Verarbeitung von Informa- ;o 
tionen liber eine Vielzahl von Zellschichten, 
wobei Schichten, die Zellen umfassen, welche 
innerhalb der Schicht Shnliche Funktionen 
durchfuhren, in aufeinanderfolgenden geordne- 
ten Stufen (uo, ui, ... u„) organisiert sind, wobei 75 
das System umfaBt: 

- eine Vielzahl von afferenten Signalpfa- 
den, die sich mittels Merkmalsextrak- 
tions-Sperrzellen (u sv ) zwischen Zell- 
schichten niedrigerer Ordnung mit Merk- 20 
malsextraktionszellen (u s -i) und Zell- 
schichten hoherer Ordnung Merkmalsex- 
traktionszellen (u s -„) zur Verarbeitung 

von afferenten Informationssignalen er- 
strecken; und 25 

- eine Vielzahl von efferenten Signalpfa- 
den, die sich mit Hilfe von Merkmalsan- 
zeige-Sperrzellen (w sv ) zwischen Zell- 
schichten hQherer Ordnung mit Merk- 
malsanzeigezellen (w s _ n ) und Zellschich- 30 
ten niedriger Ordnung mit Merkmalsan- 
zeigezellen (w s -i) zum Ubertragen eines 
efferenten Signals erstrecken, wobei die 
Merkmalsextraktionszelle (u s ) in dem af- 
ferenten Signalpfad mit der Merkmalsan- 35 
zeigezelle (w s ) in jeder Stufe verbunden 

ist und die MerkmalsextraktionsSperrzel- 
le (u sv ) konvergierend und modifizierbar 
anregend mit der Merkmalsextraktions- 
zelle (u s ) in der gleichen Stufe verbunden 40 
ist und die Merkmalsanzeige-Sperrzelle 
(w sv ) modifizierbar sperrend mit der 
Merkmalsanzeigezelle (w s ) verbunden ist, 
urn die Merkmalsanzeigezelle (w s -i) der 
nachst niedrigeren Stufe divergierend zu 45 
verbinden, 
dadurch gekennzeichnet, daB: 

- der afferente Signalpfad eine erste Merk- 
malsintegrationszelle (u co ) in der niedrig- 

sten Stufe und ein Paar aus einer Merk- 50 
malsextraktionszelle (u s ) und einer Merk- 
malsintegrationszelle (u c ) in jeder hohe- 
ren Stufe umfaBt und die hochste Stufe 
mit einem Maximumdetektor verbunden 
ist; 55 

- der efferente Signalpfad ein Paar einer 
integrierenden Merkmalsanzeigezelle (w c ) 

. und einer Merkmalsanzeigezelle (w s ) in 



jeder Stufe umfaBt und die integrierende 
Merkmalsanzeigezelle (w c ) der hochsten 
Stufe mit dem Maximumdetektor verbun- 
den ist und die niedrigste Stufe aus der 
integrierenden Merkmalsanzeigezelle (w c ) 
besteht und jede integrierende Merk- 
malsanzeigezelle (w c ) in jeder Stufe mit 
der entsprechenden Merkmalsintegra- 
tionszelle (u c ) in jeder Stufe verbunden 
ist, wobei die efferenten Signale durch 
eine Vielzahl von integrierenden Merk- 
malsanzeigezellen (w c ) und Merkmalsan- 
zeigezellen (w s ) alternierend und diver- 
gierend gesteuert werden, wobei jede in- 
tegrierende Merkmalsanzeigezelle (w c ) 
Pfade zu einer Vielzahl von Merkmalsan- 
zeigezellen (w s ) in der gleichen Stufe 
vorsieht, wobei jede Gruppe der zwei 
Vielzahlen von integrierenden 
Merkmalsanzeige(w c ) und Merkmalsan- 
zeige-Zellen (w s ) einer Stufe der Stufen 
entsprechen; 

Zellschichten in jeder Stufe auBer der 
Schicht (u 0 ) der niedrigsten Stufe fur die 
Eingangszelle konvergierende afferente 
Verbindungen von Merkmalsextraktions- 
zelle (u s ) mit MerkmalsintegrationszeNen 
(u c ) und divergierende efferente Verbin- 
dungen von einer integrierenden Merk- 
malsanzeigezelle (w 0 ) mit Merkmalsan- 
zeigezellen (w s ) aufweisen; 
wobei jede Merkmalsextraktionszelle (u s ) 
verbunden ist, urn ein nicht modifizierba- 
res anregendes Signal Oder Torsignal an 
die entsprechende Merkmalsanzeigezelle 
(w s ) innerhalb der gleichen Stufe zu sen- 
den und jede integrierende Merkmalsan- 
zeigezelle (w c ) verbunden ist, urn ein 
Verstarkungs-Steuersignal an eine ent- 
sprechende Merkmalsintegrationszelle 
(u c ) innerhalb der gleichen Stufe zu sen- 
den und die Sendung von efferenten Si- 
gnalen durch die afferenten Signale in 
der Merkmalsanzeigezelle (w s ) geschaltet 
wird und gleichzeitig die Sendung der 
afferenten Signale durch das Vorliegen 
der efferenten Signale in der integrieren- 
den Merkmalsanzeigezelle (w c ) erleich- 
tert wird, wobei beitragende Pfade der 
efferenten Signalpfade durch einen Anre- 
gungseffekt beeinfluBt werden, wahrend 
nicht beitragende Pfade davon durch ei- 
nen Sperreffekt beeinfluBt werden; 
wobei ein Muster entsprechend der Zel- 
le, die den groBten Ausgang von den 
Merkmalsintegrationszellen (u c ) der 
hochsten Stufe hervorbringt, als erkannt 
interpretiert wird; und der Ausgang der 
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integrierenden Merkmalsanzeigezellen 
(w co ) der niedrigsten Stufe als der Aus- 
gang eines assoziativen Zuruckrufs oder 
als das Ergebnis einer Segmentierung 
eines einzelnen Musters interpretiert 5 
wird, welches nun erkannt wird. 

Hierarchisches Informationsverarbeitungs-Sy- 
stem zur parallelen Verarbeitung von Informa- 
tionen liber eine Vielzahl von Zellschichten w 
nach Anspruch 1 , 
gekennzeichnet durch 

eine Schwellwert-Steuerzelle (Wc*) zum Emp- 
fangen von Signalen von der integrierenden 
Merkmalsanzeigezelle (w c ) uber nicht modifi- 75 
zierbare Anregungsverbindungen und zum 
Empfangen von konvergierenden Signalen von 
den Merkmalsextraktionszellen (u s ) in der glei- 
chen Stufe und zum Steuern der Selektivitat 
zur Extraktion von besonderen Merkmalen 20 
durch die Merkmalsextraktionszellen (u s ). 

Hierarchisches Informationsverarbeitungs-Sy- 

stem zur parallelen Verarbeitung von Informa- 

tionen Uber eine Vielzahl von Zellschichten 25 

nach Anspruch 2, 

dadurch gekennzeichnet, da6 

die Sperrzelle (u^) konvergierend ein Mustersi- 

gnal von den Merkmalsintegrationszellen (u c ) 

der vorangehenden Stufe empfangt und Aus- 30 

gangssighale uber modifizierbare Sperrverbin- 

dungen an die Merkmalsextraktionszelle (u s ) in 

der gleichen Stufe sendet. 

Hierarchisches Informationsverarbeitungs-Sy- 35 
stem zur parallelen Verarbeitung von Informa- 
tionen uber eine Vielzahl von Zellschichten 
nach Anspruch 2 oder 3, 
dadurch gekennzeichnet, daB 
die Merkmalsanzeige-Sperrzelle (w sv ) mit der 40 
Merkmalsanzeigezelle (w s ) in der gleichen Stu- 
fe verbunden ist und divergierend und nicht 
modifizierbar mit der integrierenden Merkmals- 
anzeigezelle (w c ) in der niedrigeren Stufe ver- 
bunden ist. 45 

Hierarchisches Informationsverarbeitungs-Sy- 
stem zur parallelen Verarbeitung von Informa- 
tionen uber eine Vielzahl von Zellschichten 
nach einem der Anspruche 2 bis 4, so 
dadurch gekennzeichnet, daS 
es auBerdem eine Ruckfiihrungseinrichtung 
umfaBt, urn ein von einem Maximumdetektor 
abgeleitetes Signal (x) zu senden, wenn kein 
Ausgang von irgendeiner Merkmalsintegra- 55 
tionszelle (u c ) der hochsten Stufe abgeleitet 
wird, urn so die Selektivitat einer Ziel-Merkmal- 
sextraktionszelle (u s ) zu verkleinern. 



6. Hierarchisches Informationsverarbeitungs-Sy- 
stem zur parallelen Verarbeitung von Informa- 
tionen uber eine Vielzahl von Zellschichten 
nach Anspruch 2, 
, dadurch gekennzeichnet, daB 
der afferente Signalpfad der Merkmalsintegra- 
tionszelle (u c ) und der Merkmalsextraktionszel- 
le (u s ) und der efferente Signalpfad der inte- 
grierenden Merkmalsanzeigezelle (w c ) und der 
Merkmalsanzeigezelle (w s ) so verbunden sind, 
urn das efferente Signal durch eine Verstar- 
kungssteuersignal von einer integrierenden 
Merkmalsanzeigezelle (w c ) zu beeinfluBen und 
urn das efferente Signal durch ein Torsignal 
von einer Merkmalsextraktionszelle (u s ) an die 
Merkmalsanzeigezelle (w s ) zu beeinfluBen; und 
die Merkmalsextraktionszelle (u s ) durch ein 
Ruckfuhrungssignal (x) von einem Maximum- 
detektor in der hochsten Stufe beeinfluBt wird 
und die integrierende Merkmalsanzeigezelle 
(w c ) durch ein nicht modifizierbares Sperrsignal 
von der durch eine Merkmalsanzeigezelle (w s ) 
aktivierte Merkmalsanzeige-Sperrzelle (w sv ) be- 
einfluBt wird. 

Revendications 

1. Dispos'rtif de traitement hierarchique de I'infor- 
mation pour traiter 1'information en parallels sur 
une pluralite de couches de cellules dans les- 
quelles les couches comprenant des cellules 
oui accomplissent des fonctions similaires 
dans la couche sont organisees en etages 
ordonnes successivement (Uo,U1,...,Un), ledit 
dispositif comprenant: 

une pluralite de voies de signaux afferents 
s'etendant a partir des couches de cellules du 
rang le plus bas des cellules d'extraction de 
caracteristique (Us-1) vers les couches de cel- 
lules du rang le plus eleve des cellules d'ex- 
traction de caracteristique (Us-n) avec I'aide de 
cellules d'inhibition d'extraction de caracteristi- 
que (Usv) pour traiter les signaux d'information 
afferents, et 

une pluralite de voies de signaux efferents 
s'etendant des couches de cellules indicatrices 
de caracteristique (Ws-n) de plus haut rang 
vers des couches de cellules indicatrices de 
caracteristique (Ws-1) de plus bas rang pour 
transmettre un signal efferent avec I'aide d'une 
cellule d'inhibition indicatrice de caracteristique 
(Wsv), dans lequel ladite cellule d'extraction de 
caracteristique (Us) dans la voie du signal affe- 
rent est connectee a ladite cellule indicatrice 
de caracteristique (Ws) dans chaque etage et 
ladite cellule d'inhibition d'extraction de carac- 
teristique (Usv) est connectee de maniere exci- 
tatoire convergente et modifiable a ladite cellu- 
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le d'extraction de caracteristique (Us) dans le 
meme etage et ladite cellule d'inhibition indica- 
trice de caracteristique (Wsv) est connectee de 
maniere inhibitoire et modifiable de ladite cel- 
lule indicatrice de caracteristique (Ws) a 5 
connecter de maniere divergente a la cellule 
indicatrice de caracteristique (Ws-1) de I'etage 
immediatement inferier, 
caracterise en ce que: 

ladite voie de signal afferent comprend 10 
une premiere cellule d' integration de caracte- 
ristique (Uco) dans I'etage le plus bas et une 
paire de cellule d'extraction de caracteristique 
(Us) et une cellule d'integration de caracteristi- 
que (Uc) dans chaque etage plus eleva. et 15 
I'etage le plus eleve est connecte a un detec- 
teur de maximum; 

ladite voie de signal efferent comprend 
une paire de cellule d'integration indicatrice de 
caracteristique (Wc) et une cellule indicatrice 20 
de caracteristique (Ws) dans chaque etage et 
la cellule d'integration indicatrice de caracteris- 
tique (Wc) de I'etage le plus eleve est connec- 
tee audit detecteur de maximum, et I'etage le 
plus bas est constitue de la cellule d'integra- 25 
tion indicatrice de caracteristique (Wc) et cha- 
que cellule d'integration indicatrice de caracte- 
ristique (Wc) dans chaque etage est connectee 
a la cellule correspondante d'integration de 
caracteristique (Uc) dans chaque etage, dans 30 
lequel lesdits signaux efferents sont comman- 
des par une pluralite de cellules d'integration 
indicatrices de caracteristique (Wc) et de cellu- 
les indicatrices de caracteristique (Ws) de ma- 
niere alternative et divergente, si bien que cha- 35 
que cellule d'integration indicatrice de caracte- 
ristique (Wc) fournit des voies a une pluralite 
de cellules indicatrices de caracteristique (Ws) 
dans le m§me etage, chaque groupe desdites 
deux pluralites de cellules d'integration indica- 40 
trices de caracteristique (Wc) et indicatrices de 
caracteristique (Ws) correspondant a un etage 
desdits etages; 

des couches de cellules dans chaque eta- 
ge, a Pexception de la couche de cellules 45 
d'entree (Uo) de I'etage le plus bas, ayant ces 
connexions afterentes convergentes a partir 
des cellules d'extraction de caracteristique 
(Us) vers les cellules d'integration de caracte- 
ristique (Uc) et des connexions efterentes di- 50 
vergentes a partir d'une cellule d'integration 
indicatrice de caracteristique (Wc) vers une 
cellule indicatrice de caracteristique (Ws) ; 

dans lequel chaque cellule d'extraction de 
caracteristique (Us) est connectee pour en- 55 
voyer un signal excitateur non modifiable ou 
un signal de porte a la cellule indicatrice ce de 
caracteristique (Ws) correspondante a Pinte- 



rieur du meme etage, et chaque cellule d'inte- 
gration indicatrice de caracteristique (Wc) est 
connectee pour envoyer un signal de comman- 
de de gain vers une cellule d' integration de 
caracteristique (Uc) correspondante a I'inte- 
rieur du meme etage, et la transmission des 
signaux efferents est passee par une porte par 
les signaux afferents dans la cellule indicatrice 
de caracteristique (Ws), et simultanement, la 
transmission des signaux afferents est facilitee 
par la presence des signaux efferents dans la 
cellule d'integration indicatrice de caracteristi- 
que (Wc) si bien que celles des voies des 
signaux efferents qui contribuent sont affectees 
par un effet d'excitation, tandis que celles qui 
ne contribuent pas sont affectees par un effet 
d'inhibition; 

si bien qu'un canevas correspondant a la . 
cellule qui donne la plus grande sortie parmi 
les cellules d'integration de caracteristique 
(Uc) de I'etage le plus eleve est interprets 
comme reconnu; et la sortie des cellules d'in- 
tegration indicatrices de caracteristique (Wc) 
de I'etage le plus bas est interpretee comme la 
sortie de la memoire de rappel associative ou 
comme le resultat de la segmentation d'un 
canevas unique qui est en train d'etre reconnu. 

2. Un dispositif de traitement hierarchique de Tin- 
formation en parallele sur une pluralite de cou- 
ches de cellules selon la revendication 1, ca- 
racterise par 

une cellule de commande de seuil (Wcx) 
pour recevoir des signaux depuis la cellule 
d'integration indicatrice de caracteristique (Wc) 
a travers des connexions d'excitation non mo- 
difiables et recevant des signaux convergent^ 
depuis les cellules d'extraction de caracteristi- 
que (Us) a I'interieur du m§me etage et com- 
mandant la sdlectivite pour I'extraction de ca- 
racteristiques particulieres par lesdites cellules 
d'extraction de caracteristique (Us). 

3. Un dispositif de traitement hierarchique de Pin- 
formation en parallele sur une pluralite de cou- 
ches de cellules selon la revendication 2, ca- 
racterise par ladite cellule d'inhibition (Usv) 
recevant de maniere convergente un signal ce 
canevas depuis lesdites cellules d'integration 
de caracteristique (Uc) de I'etage precedent et 
envoyant des signaux de sortie a travers des 
connexions d'inhibition modifiables vers ladite 
cellule d'extraction de caracteristique (Us) a 
I'interieur du meme etage. 

4. Un dispositif de traitement hierarchique de Pin- 
formation en parallele sur une pluralite de cou- 
ches de cellules selon la revendication 2 ou 3, 
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caracterise en ce que ladite cellule indicatrice 
de caracteristique (Wsv) est connectee a la 
cellule indicatrice de caracteristique (Ws) a 
I'interieur du meme etage et est connectee de 
maniere divergente et non modifiable a la cel- 
lule d'integration indicatrice de caracteristique 
(Wc) dans I'etage inferieur. 

Un dispositif de traitement hierarchique de ('in- 
formation en parallele sur une pluralite de cou- 
ches de cellules selon I'une des revendications 
2 a 4, caracterise en ce qu'il comprend, en 
outre, des moyens de contre-r^action pour 
transmettre un signal (x) derive d'un detecteur 
de maximum lorsqu'aucune sortie n'est deri- 
vee de i'une des cellules d'integration de ca- 
racteristique (Uc) de I'etage le plus eleve de 
maniere a abaisser la selectivity, de chaque 
cellule cible d'extraction de caracteristique 
(Us). 

Un dispositif de traitement hierarchique de ('in- 
formation en parallele sur une pluralite de cou- 
ches de cellules selon la revendication 2, ca- 
racterise en ce que la voie du signal afferent 
de la cellule d'integration de caracteristique 
(Uc) et de la cellule d'extraction de caracteristi- 
que (Us) et la voie du signal efferent de la 
cellule d'integration indicatrice de caracteristi- 
que (Wc) et la celle indicatrice de caracteristi- 
que (Ws) sont interconnected de maniere a 
affecter ledit signal efferent par un signal de 
commande de gain depuis la cellule d'integra- 
tion indicatrice de caracteristique (Wc) et pour 
affecter le signal efferent par un signal de 
porte de la cellule d'extraction de caracteristi- 
que (Us) vers la cellule indicatrice de caracte- 
ristique (Ws) ; et la cellule d'extraction de 
caracteristique (Us) est affectee par le signal 
de contre-reaction (x) provenant d'un .detecteur 
de maximum dans I'etage le plus eleve, et la 
cellule d'integration indicatrice de caracteristi- 
que (Wc) est affectee par un signal inhibiteur 
non modifiable provenant de la cellule d'inhibi- 
tion indicatrice de caracteristique (Wsv) activee 
par une cellule indicatrice de caracteristique 
(Ws). 
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